---
sidebar_position: 0
---

# Docker

This guide explains how to launch Tabby using docker.

import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';

<Tabs>
  <TabItem value="cuda" label="CUDA" default>


  For CUDA support in Tabby, install the [NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html).
  After installation, you can start Tabby with the following command:

  ```bash title="run.sh"
  docker run -it --gpus all \
    -p 8080:8080 -v $HOME/.tabby:/data \
    registry.tabbyml.com/tabbyml/tabby \
    serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda
  ```

  </TabItem>

  {false && <TabItem value="cpu" label="CPU" default>

  ```bash title="run.sh"
  docker run --entrypoint /opt/tabby/bin/tabby-cpu -it \
    -p 8080:8080 -v $HOME/.tabby:/data \
    registry.tabbyml.com/tabbyml/tabby \
    serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct
  ```

  </TabItem>}
</Tabs>
